Human-computer protocols

We have recently developed an approach to modelling interaction that encompasses not just the device, but also aspects of a cognitive model. This integrated framework, called syndetic modelling, has been used to reason about the interplay between cognitive and computational resources deployed within an interaction. Here, a new view on this integrated framework is described. We consider the interaction between user and device as forming a hierarchy of protocols, covering different levels of abstraction over the information exchanged. As the protocol is layered, we can discuss interaction in terms of different levels of granularity, better accommodating the representation of new technologies such as vision tracking and speech which can be considered as ‘continuous’ at some levels. We conclude by summarising classes of mathematical representation that can be utilised to represent and reason within such a model.